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© Image superimposing apparatus. 

© An image superimposing apparatus for superim- 
posing a plurality of images into one image for 
display includes an operation circuit (31) lor obtain- 
ing an image data rejated to a next frame based on 
an image data related to a present frame and a 
differential image data of a plurality of images, a 
memory (20) including first and second banks (21, 
22) each having a memory capacity for storing at 
least one frame of image data, an address generator 
(25) for generating a display address which is used 
for making access to the first and second memory 
banks when reading image data for display, a dis- 
play controller (23) for storing display image num- 
bers which distinguish the plurality of images in 



correspondence with regions of each of the first and 
second banks, and a bank controller (26) for storing 
bank numbers of the first and second banks in 
correspondence with the display image numbers to 
indicate the bank from which the image data is 
presently being read out for display. The bank con- 
troller outputs a bank number in response to the 
display image number from the display controller, 
and the display address from the address generator 
and the bank number of the bank controller des- 
ignate one of the first and second banks and its 
region from which the image data is to be read out 
for display. 
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BACKGROUND OF THE INVENTION 

The present invention generally relates lo Im- 
age superimposing apparatuses, and more particu- 
larly to an image superimposing apparatus which 
superimposes a plurality of images into one image 
lor display. 

In a video conference system, for example, a 
so-called interframe differential system is used for 
transmitting the image. According to the interframe 
differential system, differential data are obtained 
from differential components between frames of the 
image and transmitted. The original image is repro- 
duced and displayed from ihe differential data. 

The interframe differential system will be de- 
scribed in conjunction wilh FIGS. 1 A and IB. As 
shown in FIG.1A. the image superimposing appara- 
tus is provided wilh two framo memories 10 and 11 
and an operation circuit 13. The operation circuit 
13 adds the image data which is read out from the 
frame memory 10 which is supplying the image 
data for display on a display device (not shown) 
and the differential image data which is received 
via a terminal 12. The image data which is obtained 
by the addition and is related to the next frame is 
written into the frame memory 11. Next, as shown 
in FIG.1B. the image data read out from the frame 
memory 11 is supplied to the display device for 
display, and the image data which is related to the 
next frame and is obtained in the operation circuit 
13 similarly as described above is written into the 
frame memory 10. 

Conventionally, the video conference system 
separates the portrait image which is related to a 
person and includes large motion and tho back- 
ground image which is related lo the background 
such as the conference room and includes only 
small motion. The two kinds of images are trans- 
mitted by taking the interframe differential compo- 
nents with a period dependent on the motion in- 
cluded in the images. FIG.2 shows an example of a 
conventional image superimposing apparatus which 
is used for superimposing the two kinds of images. 

In FIG. 2, the. image data which is obtained in 
an operation circuit 13a based on the differential 
data of the background image received from a 
terminal 12a and the image data related to the 
present frame is alternately written into frame 
memories 10a and 11 a. Similarly, the image data 
which is obtained in an operation circuit 13b based 
on the differential data of the portrait image re- 
ceived from a terminal 12b and the image data 
related to the present frame is alternately written 
into frame memories 10b and 11b. 

The image data read out from the frame 



memories 11a and 10b in synchronism with each 
other are superimposed in a superimposing circuit 
15 and supplied to a display device 16. Hence, an 
image in which a portrait image 16b is superim- 

5 posed within a background image 16a is displayed 
on the display device 16. 

According to the conventional image superim- 
posing apparatus, however, it is necessary to pro- 
vide two frame memories for each image which is 

w to be superimposed on another image. For exam- 
ple, six frame memories are required when super- 
imposing three images. For this reason, there is a 
problem in that the number of frame memories 
required increases as the number of images to be 

is superimposed increases. 

On the other hand, if the images were to be 
superimposed on the transmitting side and trans- 
mitted, the receiving side wou|d only require two 
frame memories regardless of the number of im- 
20 ages which are superimposed. However, it is im- 
possible in this case to concentrate on the trans- 
mission of only the portrait image which includes 
large motion. In addition, it is impossible in this 
case to superimpose the images which are re- 
25 ceived from various locations of a multi-point video 
conference system into one image for display. 

SUMMARY OF THE INVENTION 

30 

Accordingly, it is a general object of the 
present invention to provide a novel and useful 
image superimposing apparatus in which the prob- 
lems described above are eliminated. 

35 Another and more specific object of the 

present invention is to provide an image superim- 
posing apparatus for superimposing a plurality of 
images into one image for display, comprising op- 
eralion means for obtaining an image data related 

40 to a next frame based on an image data related to 
a present frame and a differential image data of a 
plurality of images, memory means coupled to the 
operation means including first and second brinks 
each having a memory capacity for storing at least 

-/G one frame of image data, address generating 
means coupled to the memory means for generat- 
ing a display address which is used for making 
access to the first and second memory banks when 
reading image data for display, display control 

'so means coupled to the address generating means 
for storing display image numbers which distin- 
guish the plurality of images in correspondence 
with regions of each of the first and second banks, 
where the display control means outputs a display 
image number in response to the display address 

\ 



3 



EP 0 414 222 A2 



4 



from the address generating means, and bank con- 
trol means coupled to the display control means for 
storing bank numbers of the first and second banks 
in correspondence with the display image numbers 
to indicate the bank from which the image data is 
presently being read out for display. The bank 
control means outputs a bank number in response 
to the display image number from the display 
control means, and the display address from the 
address generating means and the bank number of 
the bank control means designate one of the first 
and second banks and its region from which the 
image data is to be read out for display. According 
to the image superimposing apparatus of the 
present invention, it is possible to transmit each 
image depending on the motion included therein. 
Further, it is possible to superimpose a large num- 
ber of images by the use of the memory means 
which may only have a minimum storage capacity 
of two frames. As a result, the image superim- 
posing apparatus has a simple circuit structure and 
is inexpensive. 

Other objects and further features of the 
present invention will be apparent from the follow- 
ing detailed description when read in conjunction 
with the accompanying drawings. 

BRIEF DESCRIPTION OF THE DRAWINGS 

FIGS. tA and 1B are system block diagrams for 
explaining the interframe differential system; 
FIG.2 is a system block diagram showing an 
example of a conventional image superimposing 
apparatus; 

FIG.3 is a system block diagram showing an 
embodiment of an image superimposing appara- 
tus according to the present invention; 
FIG.4 is a diagram for explaining a bank table 
and the utilization of banks; and 
FIG.5 is a flow chart for explaining an operation 
of a write controller shown in FIG.3. 

DESCRIPTION OF THE PREFERR ED EMBODI- 
MENTS 

FIG.3 shows an embodiment of an imago 
superimposing apparatus according to the present 
invention. The imago superimposing apparatus 
generally includes an image memory part 20, a 
display controller 23, a display address generator 
25, a bank controller 26, a write controller 30 and 
an operation circuit 31. The image memory part 20 
is made up of two banks 21 and 22. The display 
controller 23 includes a display region table, and 
the bank controller 26 includes a bank table 27. 
The image superimposing apparatus is coupled Jo 
a display device 28. 



The banks 21 and 22 of the image memory 
part 20 respectively have a memory capacity suffi- 
cient to store image data amounting to one frame. 
The banks 21 and 22 are respectively designated 
o by a 1-bit bank number, and an n-bit address 
designates the addresses of the image data within 
each bank. 

An access is made to the display region table 
24 of the display controller 23 by an n-bit address, 
to similarly as in the case of the banks 21 and 22. At 
each address of the display region table 24, there 
is stored a display image number which designates 
the image to be displayed in the region. 

The display address generator 25 successively 
15 generates an n-bit display address for reading out 
the image data from the bank 21 or 22 in order to 
display the image on the display device 28. This n- 
bit display address from the display address gener- 
ator 25 is supplied to both the imago memory part 

20 21 and the display controller 23. The display image 
number which is read out from the display region 
table 24 based on the n-bit display address is 
supplied to the bank controller 26. 

The table elements making up the bank table 

p.5 27 of the bank controller 26 correspond to the 
display image numbers. Each table element stores 
a 1-bit bank number "0" or "1" which designates 
whether the image data which is presently being 
displayed is read out from the bank 21 or 22. The 

30 bank number which is read out from the table 
element corresponding to the display image num- 
ber which is received from the display controller 23 
is supplied to the image memory part 20. 

The access to the image memory part 20 is 

35 made based on the bank number which is received 
from the bank controller 26 and the display ad- 
dress which is received from the display address 
generator 25. and the image data read out from the 
designated bank 21 or 22 of the image memory 

40 part 20 is supplied to the display device 28 to be 
displayed thereon. 

In FIG.3. the image which is displayed on the 
display device 28 is divided into four regions 24a 
through 24d of the display region table 24 which 

■/g respectively correspond to the display image num- 
bers (T) through @. The bank numbers which are 
stored in table elements 27a through 27d «>f Hhs 
bank table 27 and respectively conespond lu II iu 
display image numbers (T) through (j) are "0", 

so "1", "1 M and "0". Hence, the image is displayed on 
the display device 28 based on the image data 
read out from regions 21a and 21 d of the bank 21 
indicated by the hatchings and regions 22b and 
22c of the bank 22 indicated by the hatchings. 

55 The write controller 30 rewrites the display 
image number of the display region table 24 and 
also rewrites the bank number in each table ele- 
ment of the bank table 27. The rewriting of the 
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bank number is carried out with respect to the 
table element corresponding to the display image 
number when the differential image data of the 
image corresponding to that display image number 
is received from a terminal 32. The rewrite control- 
ler 30 is informed of the receipt of the differential 
image data of the image corresponding to a display 
image number at the terminal 32 based on a signal 
which is received from the operation circuit 31. In 
addition, the write controller 30 supplies to the 
image memory part 20 the rewriting address of the 
image data which is to be rewritten within the 
image memory part 20 whon the differential image 
data is received from the terminal 32. Accordingly, 
the image data read out from the rewriting address 
of one of regions 21b. 21 c. 22a and 22d in the 
banks 21 and 22 of the image memory part 20 is 
supplied to the operation circuit 31 where the im- 
age data is added with the differential image data 
from the terminal 32 to generate a new image data. 
This new image data is rewritten into the rewriting 
address of one of the regions 21b. 21c. 22a and 
22d in the banks 21 and 22 of the image memory 
part 20. In other words, the image data read from 
the image memory part 20 is supplied to the op- 
eration circuit 31 as the image data related to the 
present frame, and the new image data from the 
operation circuit 31. is written into the image mem- 
ory part 20 as the image data related to the next 
frame. 

When carrying out the rewriting of Ihe image 
corresponding to the display image number © in 
the displaying state shown in FIG.3, the rewrite 
controller 30 rewrites the bank number of the table 
element 27b to "0" as shown in FIG. 4. As a result, 
the image data in the regions 21a, 21b. 22c and 
21 d of the banks 21 and 22 indicated by the 
hatchings in FIG.4 are successively read out and 
displayed on the display device 28. 

FIG. 5 is a flow chart for explaining the opera- 
lion of the rewrite controller 30. In FIG.5, a step S1 
writes the display image numbers into the display 
region table 24 of the display controller 23. A step 
S2 designates the initial bank numbers in the bank 
table 27 of the bank controller 26. A step S3 judges 
whether or not the bank number corresponding to 
the display image number Q) is supplied to Iho 
image memory part 20. When the judgement result 
in the step S3 is YES. a step S4 rewrites the batik 
fiumber in the bank table 27 corresponding to the 
display image number (T) . Whon the judgement 
result in the step S3 is NO or after the step S4, a 
step S5 judges whether or not the the bank number 
corresponding to the display image number 0 is 
supplied to the image memory part 20. When the 
judgement result in the step S5 is YES, a step SG 
rewrites the bank number in the bank table 27 
corresponding to the display image number © 



Steps similar to the steps S3 and S4 are carried 
out thereafter for all display image numbers, that is, 
up to the display image number 0 in this embodi- 
ment. After the rewriting of the bank number in ihe 
5 bank table 27 corresponding to the display image 
number 0 ends, the process returns to the step 
S3. 

Therefore, according to this embodiment, the 
access to the display region table 24 is made by 
to the display address so as to obtain the display 
image number, and this display image number is 
used to obtain the bank number from the bank 
table 27 so as to determine whether the image data 
is to be read out from the bank 21 or 22. Between 
*5 the two banks 21 and 22 respectively having the 
memory capacity amounting to at least one frame 
and less than two frames, it is possible to read out 
the image data from the region where no rewriting 
of the image data is carried out when superim- 
20 posing a plurality of images for display on the 
display device 28. In addition, each image can be 
transmitted depending on the degree of motion 
therein and be written into the corresponding re- 
gion of one of the two banks 21 and 22. Accord- 
20 ingly, it is possible to superimpose into one image 
the images received from a plurality of locations of 
a multi-point video conference system, for exam- 
ple, by use of only two banks 21 . and 22 which 
together have a memory capacity amounting to a 
30 minimum of two frames, regardless of the number 
of images which are to be superimposed. 

Of course, the present invention is no limited to 
the application to the multi-point video conference 
system and is similarly applicable to other systems 
35 which require superimposing of images. An exam- 
ple of such other systems, there is the security 
system which has a monitoring station for monitor- 
ing images received from a plurality of video cam- 
eras located at various check points. In this case, 
-jo the present invention can be used to superimpose 
the images from the video cameras into one image 
so as to facilitate the monitoring process. 

Further, the present invention is not limited to 
these embodiments, but various variations and 
</* modifications may be made without departing from 
the scope of the present invention. 

Reference signs in the claims are intended for 
bettor understanding and shall not limit the scofie. 

r>0 

Claims 

1 . An image superimposing apparatus for superim- 
posing a plurality of images into one image for 
55 display, said image superimposing apparatus com- 
prising operation means (31) for obtaining an im- 
age data related- to a next frame based on an 
image data related to a present frame and a dif- 
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